Storage Capacity of Kernel Associative Memories
نویسندگان
چکیده
This contribution discusses the thermodynamic phases and storage capacity of an extension of the Hopfield-Little model of associative memory via kernel functions. The analysis is presented for the case of polynomial and Gaussian kernels in a replica symmetry ansatz. As a general result we found for both kernels that the storage capacity increases considerably compared to the Hopfield-Little model.
منابع مشابه
Storage capacity of holographic associative memories.
The storage capacity of holographic associative memories is estimated. An argument based on the available degrees of freedom shows that the number of patterns that can be stored is limited by the space-bandwidth product of the hologram divided by the number of pixels in each pattern. A statistical calculation shows that if we attempt to store associations by multiply exposing the hologram, the ...
متن کاملGeneralized Asymmetrical Bidirectional Associative Memory*
A classical bidirectional associative memory (BAM) suffers from low storage capacity and abundance of spurious memories though it has the properties of good generalization and noise immunity. In this paper, Hamming distance in recall procedure of usual asymmetrical BAM is replaced with modified Hamming distance by introducing weighting matrix into connection matrix. This generalization is valid...
متن کاملInformation storage capacity of incompletely connected associative memories
In this paper, the memory capacity of incompletely connected associative memories is investigated. First, the capacity is derived for memories with fixed parameters. Optimization of the parameters yields a maximum capacity between 0.53 and 0.69 for hetero-association and half of it for autoassociation improving previously reported results. The maximum capacity grows with increasing connectivity...
متن کاملNeural Associative Memories
Despite of processing elements which are thousands of times faster than the neurons in the brain, modern computers still cannot match quite a few processing capabilities of the brain, many of which we even consider trivial (such as recognizing faces or voices, or following a conversation). A common principle for those capabilities lies in the use of correlations between patterns in order to ide...
متن کاملReflexive Associative Memories
In the synchronous discrete model, the average memory capacity of bidirectional associative memories (BAMs) is compared with that of Hopfield memories, by means of a calculat10n of the percentage of good recall for 100 random BAMs of dimension 64x64, for different numbers of stored vectors. The memory capac1ty Is found to be much smal1er than the Kosko upper bound, which Is the lesser of the tw...
متن کامل